Deficiency Zero Petri Nets and Product Form 



Jean Mairesse, Hoang-Thach Nguyen 
LIAFA, Universite Paris Diderot - Paris 7, 
75205 Paris Cedex 13 
mairesse@liafa. j ussieu . fr , ngthach@liafa. j ussieu . fr 



Abstract 

Consider a Markovian Petri net with race policy. The marking pro- 
cess has a "product form" stationary distribution if the probability of 
viewing a given marking can be decomposed as the product over places 
of terms depending only on the local marking. First we observe that 
the Deficiency Zero Theorem of Feinberg, developed for chemical reac- 
tion networks, provides a structural and simple sufficient condition for 
the existence of a product form. In view of this, we study the classical 
subclass of free-choice nets. Roughly, we show that the only Petri nets 
of this class which have a product form are the state machines, which 
can alternatively be viewed as Jackson networks. 

Introduction 

Queueing networks, Petri nets, and chemical reaction networks, are three 
mathematical models of "networks", each of them with an identified com- 
munity of researchers. 

In queueing theory, the existence of "product form" Markovian networks 
is one of the cornerstones and jewels of the theory. Monographies are ded- 
icated to the subsect, e.g. Kelly [TT] or Van Dijk [9]. Roughly, the interest 
lies in the equilibrium behavior of a Markovian queueing network. The 
existence of such an equilibrium is equivalent to the existence of a station- 
ary distribution tt for the queue-length process. In some remarkable cases, 
7T not only exists but has an explicit decomposable shape called "product 
form". The interest is two-fold. First, from a quantitative point of view, 
it makes the explicit computation of tt possible, even for large systems. 
Second, the product form has important qualitative implications, like the 
"Poisson-Input Poisson-Output" Theorems. Consequently, important and 
lasting efforts have been devoted to the quest for product form queueing 
networks. 

It is attractive and natural to try to develop an analog theory for Marko- 
vian Petri nets, with the marking process replacing the queue- length pro- 
cess. There is indeed a continuous string of research on this topic since 
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the nineties, e.g. [5j El [lOj Q21 El [13 H5] . Tools have been developped in 
the process which build on classical objects of Petri net theory (e.g. closed 
support T-invariants). The most accomplished results are the ones in |14j . 

In chemistry and biology, models of chemical reaction networks have also 
emerged. Such a network is specified by a finite set of reactions between 
species of the type lt 2A + B — > C" , meaning that two molecules of A can 
interact with one molecule of B to create one molecule of C. The dynamics 
of such models is either deterministic or stochastic, see |18j . 

Deterministic models are the most studied ones; they correspond to cou- 
pled sets of ordinary differential equations. The most significant result is 
arguably the Deficiency Zero Theorem of Feinberg Deficiency Zero is 
a structural property which can be very easily checked knowing the shape 
of the reactions in a chemical network. It does not refer to any assump- 
tion on the associated dynamics. Feinberg Theorem states that if a network 
satisfies the Deficiency Zero condition, then the associated deterministic dy- 
namic model has remarkable stability properties. An intermediate result is 
to prove that a set of non-linear equations (NLE) have a strictly positive 
solution. 

Stochastic models of chemical reaction networks correspond to continuous- 
time Markov processes of a specific shape. Such models were considered in 
Chapter 8 of the seminal book by Kelly [17 . There it is proved that if a 
set of non-linear "traffic equations" (NLTE) have a strictly positive solution 
then the Markov process has a product form. 

How does Feinberg result connect with product form Markovian Petri 
nets ? 

A first observation is that chemical reaction networks and Petri nets are 
two different descriptions of the same object. This has been identified by 
different authors in the biochemical community: see for instance [3] and the 
references therein. Conversely, Petri nets were originally introduced by Carl 
Adam Petri to model chemical processes, see [22] . 

A second observation was made recently by Anderson, Craciun, and 
Kurtz [2]. They observe that the NLE of Feinberg and the NLTE of Kelly 
are the same. It implies that if a chemical network has deficiency zero, then 
the stochastic dynamic model has a product form. 

In the present paper, we combine the two observations. The Deficiency 
Zero condition provides a sufficient condition for a Markovian Petri net 
to have a product form. The Deficiency Zero condition is equivalent to 
another criterion known in the Petri net literature [13] • The advantage is 
that deficiency is easy to compute and handle. 

The class of Petri nets whose Markovian version have a product form is 
an interesting one. It is therefore natural to study how this class intersects 
with the classical families of Petri nets: state machines and free-choice Petri 
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nets. We use the simplicity of the Deficiency Zero condition to carry out 
this study. 

The central result that we prove is, in a sense, a negative result. We show 
that within the class of free-choice Petri nets, the only ones which have a 
product form are closely related to state machines. We also show that 
the Markovian state machines are "equivalent" to Jackson networks. The 
latter form the most basic and classical example of product form queueing 
networks. 

A conference version of the present paper appeared in [2D]. Compared 
with [20], additional results have been proved: the equivalence between 
deficiency and the condition of Haddad & al [13] (Prop. 12. 3p . and the 
results in Section [231 

1 Model 

We use the notation R* = R — {0}. The coordinate- wise ordering of R fc is 
denoted by the symbol ^. We say that x G R fc is strictly positive if x\ > 
for all i. We denote by I5 the indicator function of S, that is the mapping 
taking value 1 inside S and outside. 

1.1 Petri nets 

Our definition of Petri net is standard, with weights on the arcs. 

Definition 1.1 (Petri net). A Petri net is a 6-tuple (V, T, T , I, O, Mq) 

where: 

• (V,T, J 7 ) is a directed bipartite graph, that is, V and T are non-empty 
and finite disjoint sets, and J 7 is a subset of [V x T) U (T x V) ; 

• I : T -> N v , O : T -»• are such that [I(t) p > ^ (p,t) G F] and 
[O(t) p >0^(t,p)eF]; 

• M belongs to N v . 

The elements of V are called places, those of T are called transitions. 
The 5-tuple (V, T, T , I, O) is called the Petri graph. The vectors I{t) and 
0{t), t G T, are called the input bag and the output bag of the transition t. 
The weight of the arc (p, t) G T (resp. (t,p)) is I(t) p (resp. 0(t) p ). 

An element of is called a marking, and Mq is called the initial mark- 
ing. 

Petri nets inherit the usual terminology of graph theory. Graphically, 
a Petri net is represented by a directed graph in which places are repre- 
sented by circles and transitions by rectangles. The initial marking is also 
materialized: if Mq(p) = k, then k tokens are drawn inside the circle p. By 
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convention, the weights different from 1 are represented on the arcs. See 
Figures Q] or [2] for examples. 

A Petri net is a dynamic object. The Petri graph always remains un- 
changed, but the marking evolves according to the firing rule. A transition 
t is enabled in the marking M if M > I(t), then t may fire which transforms 
the marking from M into 

M' = M - lit) + 0(t) . 

We write M A- M' . A marking M' is reachable from a marking M if there 
exists a (possibly empty) sequence of transitions ti,...,tk and sequence of 
markings M\, ...,Mfc_i, such that 

M ±h Mi % ■ ■ ■ M fc _x ^> M' . 
We denote by TZ(M) the set of markings which are reachable from M. 

Definition 1.2 (Marking graph). The marking graph of a Petri net with 
initial marking Mq is the directed graph with 

• nodes: K(M ) , arcs: M -)■ M 1 if 3t G T, M 4 M'. 

The marking graph defines the state space on which the marking may 
evolve. Observe that the marking graph may be finite or infinite. In Section 
11.31 we will define a Markovian Petri net as a continuous-time Markovian 
process evolving on the marking graph. 

The analysis of Petri nets relies heavily on linear algebra techniques, the 
central object being the incidence matrix. 

The incidence matrix N of the Petri net (V, T, J~, I, O, Mq) is the (V x 
T)-matrix N defined by: 

N s , t = 0(t) s - I(t) s . (1) 

Example 1. Figured represents a Petri net with places {pi,P2,P3,Pa} and 
transitions {ti ,^2,^3, £4, H,t§}. The initial marking is Mq = (2, 0, 0, 1). Here 
all the weights of the arcs are equal to 1 . 




Figure 1: Petri net. 
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1.2 Deficiency and weak reversibility 

Consider a Petri net (V,T,J-,I,0,Mq). From now on, we assume that 
no two transitions have the same pair input bag - output bag. So we can 
identify each t with the ordered pair (l(t),0(t)). 

In the context of Markovian Petri nets with race policy (see £ )1.3p . this 
assumpion is made without loss of generality. Indeed, several transitions 
with the same pair of bags can be replaced by a single transition whose 
transition rate is the sum of the original rates. Also this transformation 
does not modify the deficiency or weak reversibility (to be defined below). 

Under this assumption, the Petri net can be viewed as a triple (V,T C 
x N^, Mo £ N^). (In particular, the flow relation T is encoded in 7~.) 
Petri nets have appeared with this presentation in different contexts and 

under different names: vector addition systems (see for instance |23j). or 

chemical reaction networks (see for instance [TT| 12]). 

In the chemical context, the elements of V are species. The marking 
is the number of molecules of the different species. The elements of T are 
reactions. A reaction (c, d) € x N 7 ' is represented as follows: 

Yl °p p ~^ Yl d p p - 

p&V p<=V 

Example 2. The "chemical" form of the Petri net in Figure{I\ is: 

Pi ^P2 P3^ Pi Pi + P3 ^ P2 + Pi ■ (2) 

Let us now introduce two notions, deficiency and weak reversibility, 
which are borrowed from the chemical literature. 

Definition 1.3 (Reaction graph). Let (P, T C# x N v , M) be a Petri net. 
A complex is a vector u in such that: 3v G N^, (u, v ) £ 7~ or (v, u) G 7". 
The set of all complexes is denoted by C. The reaction graph associated to 
the Petri net is the directed graph with nodes: C, arcs: u — )• v if (u,v) £ T ' ■ 

Let A be the node-arc incidence matrix of the reaction graph, that is the 
(C x T)-matrix defined by 

A Ujt = -l{/(t)=«} + l{o(t)=u} • ( 3 ) 

Lemma 1.1. Consider a Petri net with set of complexes C. Let £ be the 

number of connected components of the reaction graph. The rank of the 
node-arc incidence matrix satisfies: 

rank(A) = \C\ - t . (4) 
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Proof. Assume that I = 1. Consider x 6 M c — {(0, . . . , 0)} such that xA = 
(0, . . . ,0). Let C be such that xq / 0. Consider D € C. Since ^ = 1, 
there exists an undirected path (C = Co) — C\ — • • • — (Ck = D) in the 
reaction graph. Assume wlog that Ci — > Ci + \ and let U £ T be such that 
I(ti) = Ci,0(ti) = C i+ i. By definition of A, we have (xA) ti = xc 1+1 - x Ci - 
So we have xc i = xc i+1 for all i, and xc = xjj. We have proved that 
xA = (0, . . . , 0) =^ x € R(l, . . . , 1). Conversely, by definition of A, we 
have (1, . . . , 1)A = (0, ...,0). Hence dim ker(A) = 1, and by the rank 
theorem, rank( J 4) = \C\ — 1. For a general value of £, we get similarly that 
rank(^) = \C\ - £. □ 

A central notion in what follows is the deficiency of a Petri net. 

Definition 1.4 (Deficiency). With the above notations, the deficiency of the 
Petri net is 

5 = \C\ — I — rank(N) = rank(A) — rank(N) . 

Of particular importance are the Petri nets with deficiency 0. This 
class will be central in the study of Markovian Petri nets having a product 
form, see Section [2 Such Petri nets are "extremal", in a sense made precise 
by the next proposition. 

Proposition 1.1. For all x E : 

[Ax = 0] [A^ = 0] . (5) 

In particular it implies that: rank(A) > rank(N). Equivalently, the defi- 
ciency of a Petri net is always greater or equal to 0. 

The non-negativity of the deficiency appears in Feinberg [11], using a 
different argument. 

Proof. Using the definition of the matrix A, we can rewrite the condition 
Ax = as: 

vc g c, ^2 x t - ^2 Xt = ' ( 6 ) 

t:0(t)=c t:I(t)=c 

Now for each place s, we have: 

Y, N s,tx t = ^[0(t) s -/(t) s ]st 
teT teT 

ceC t:0(t)=c t:I(t)=c ceC t:0(t)=c t:I(t)=c 

Using ©, this last sum is equal to 0. 

The inequality rank(A) > rank(iV) is equivalent to dim ker(yl) < dim ker(iV), 
which follows immediately from ([5]). □ 
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The second central notion is weak reversibility. 



Definition 1.5 (Weak reversibility). A Petri net is weakly reversible (WR) 
if every connected component of the reaction graph is strongly connected. 



Weak reversibility is a restrictive property, see Section 13.31 It is im- 
portant to observe that a connected and weakly reversible Petri net is not 
necessarily strongly connected. An example is given below. 

P rt 

o- 



Elementary circuits of the reaction graph can be identified with the so- 
called "minimal closed support T-invariants" of the Petri net literature (see 
[5]). In particular, a Petri net is weakly reversible if and only if it is covered 
by minimal closed support T-invariants. Such Petri nets are called H-nets 
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Weak reversibility and deficiency 0. Weak reversibility and deficiency 
are two independent properties, see Figure [2j The upper-left Petri net is 
an instance of the famous "dining philosopher" model. The Petri nets in 
Fig. [2] are live and bounded except for the upper-right one. 




WR, 5 > 




o o o o 



Not WR, 6 > 

Figure 2: Deficiency zero and weak reversibility are independent. 



Algorithmic complexity. Weak reversibility and deficiency are algo- 
rithmically simple to check. Let us determine the time complexity of the 
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algorithms with respect to the size of the Petri net (number of places and 
transitions). 

Observe first that the number of complexes is bounded by 2T. Building 
the reaction graph from the Petri graph can be done in time 0(VT 2 ). A 
depth-first-search algorithm on the reaction graph enables to check the weak 
reversibility and to compute the number of connected components (£). The 
DFS algorithm runs in time 0(VT). Computing the rank of the incidence 
matrix can be done in time 0(VT 2 ) using a Gaussian elimination. 

Globally the complexity is OiVT 2 ) for computing the deficiency as well 
as for checking weak-reversibility. 



1.3 Markovian Petri nets with race policy 

A Petri net is a logical object with no physical time involved. There exist 
several alternative ways to define timed models of Petri nets, see for instance 
[H d] . We consider the model of Markovian Petri nets with race policy. The 
rough description is as follows. 

With each enabled transition is associated a "countdown clock" whose 
positive initial value is set at random. When a clock reaches 0, the corre- 
sponding transition fires. This changes the set of enabled transitions and 
all the clocks get reinitialized. The initial values of the clocks are chosen 
independently, according to an exponential distribution whose rate depends 
on the transition and on the current marking. With probability 1, no two 
clocks reach zero at the same time so the model is unambiguously defined. 
Enabled transitions are involved in a "race" : the transition to fire is the one 
whose clock will reach zero first. 

We now proceed to a formal definition of the model. 

When I(t) = 0(t), the firing of transition t does not modify the marking, 
nor the distribution of the value of the clocks (memoryless property of the 
exponential). Without loss of generality, we assume from now on that I(t) ^ 
0{t) for all t. 

Definition 1.6 (Markovian Petri net with race policy). A Markovian Petri 
net (with race policy) is formed by a Petri net (V, T, J 7 , 1, O, Mq) and a set 
o/rate functions (fit)teT; fH '■ H(Mq) — > , satisfying 

-I(t))$(M) if I{t) 
M M ) = <( n . (7) 

otherwise 

for some constants Kt £ M^, t E T, and some functions and <3? valued in 
The marking evolves as a continuous-time jump Markov process with 
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state space TZ(Mq) and infinitesimal generator Q = {qm,M')m,M' > given by: 
VM, VM' ^ M, Qm,M' = Yl ^( M )> VM ' qM < M = ~ qM > M ' ■ 

t:M^M> M '+ M 

(8) 

The shape ([5]) for the infinitesimal generator is the transcription of the 
informal description given at the beginning of the section. 

The condition (|7|) for the rate functions (nt)teT 1S the same as the one in 
[15j and Section 2]. (In |14t Section 3], an even more general shape for 
the rate function is considered.) Condition ([7|) is specifically cooked up in 
order for the product form result of Theorem l2.1l to hold, which explains its 
artificial shape. This general condition englobes two classical types of rate 
functions: the constant rates and the mass-action rates. 

Constant rates. In the Petri net literature, the standard assumption 
is that the firing rates are constant: 

3 Kt e r;, VM e H(M ), I(t) < M, nt{M) = Kt ■ (9) 



Mass-action rates. In the chemical literature, the rate is often pro- 
portional to the number of different subsets of tokens (i.e. molecules) that 
can be involved in the firing (i.e. reaction). More precisely: 

VMG^(M ) ) /(t)<M, iH(M) = Kt J] — Mp l {t) . (10) 

p:I(t) p ^0 P P 

Such rates are said to be of mass-action form and the corresponding stochas- 
tic process has mass-action kinetics. To obtain (|10p from ([7]), set $,^I' _1 : 



2 Product form results 

We are interested in the equilibrium behavior of Markovian Petri nets. This 
section presents the product form results which exist in the literature. We 
gather results which were spread out, obtained independently either in the 
Petri net community, or in the chemical one. 

Let Q be the infinitesimal generator of the marking process. An invariant 
measure ir of the process is characterized by the balance equations irQ = 0, 
that is: Mx G TZ(M ), 

vr(x) Yl M*)= E n(x + I(t)-0(t))iH(x + I(t)-0(t)). (11) 

t:x^I(t) t:x^O(t) 
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A stationary distribution is an invariant probability measure. It is char- 
acterized by ttQ = 0, Xlx 7r ( x ) = 1- If 77 * s an invariant measure and 
K = ^2 x& Ti^M ) 7r ( x ) < +oo, then 7r/i^ = (ir(x)/K) x is a stationary dis- 
tribution. 

When the marking graph is strongly connected, the marking process is 
irreducible. It follows from the basic Markovian theory that the stationary 
distribution is unique when it exists (the ergodic case). When the state 
space is finite, irreducibility implies ergodicity. 

2.1 Non-linear traffic equations and Kelly's Theorem 

Definition 2.1 (Non- linear traffic equations). Consider a Markovian Petri 
net with general rates. Let C be the set of complexes. We call non-linear 
traffic equations (NLTE) the equations over the unknowns (x p ) pe -p defined 
by: VC G C, 

n ^ v e e «* n x v t)p - ( i2 ) 

p:C p ^0 t:I(t)=C t:0(t)=C p:I(t) p ^0 

(With the usual convention that the empty product is 1.) 

The NLTE can be viewed as a kind of balance equations (what goes in 
equals what goes out) at the level of complexes. Their central role appears 
in the next theorem which is essentially due to Kelly [171 Theorem 8.1] (see 
also [21 Theorem 4.1]). In Kelly's book, the setting is more restrictive, but 
the proof carries over basically unchanged. 

Theorem 2.1 (Kelly). Consider a Markovian Petri net. Assume that the 
NLTE admit a strictly positive solution (u p ) pe .-p. Then the marking 

process of the Petri net has an invariant measure tt defined by: \/x G TZ(Mq), 

tt(x) = ^(x)- 1 J] 4 P . (13) 

We then say that tt has a product form: tt(x) decomposes as a product 
over the places p of terms depending only on the local marking x p . 

Observe that tt(x) > for all x in (|13p . In particular it implies that the 
marking process is irreducible. On the other hand, the measure defined in 
(|13p may have a finite or infinite mass. When it has a finite mass, the mark- 
ing process is ergodic, and the normalization of tt is the unique stationary 
distribution. 

In the case of mass-action rates (|1(J|) . we get 

e *«- e n£ < e nfr= «<p<e 

xeTZ(Mo) x£lZ(M )p&T p ' xGN^peP p ' P 
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So we are always in the ergodic case. For constant rates ([9]), if the state space 
TZ(Mq) is infinite, the ergodicity depends on the values of the constants K t . 

Theorem 12.11 is the core result. Below, all the developments consist in 
determining conditions under which Theorem 12.11 applies. More precisely, 
we want conditions on the model ensuring the existence of a strictly positive 
solution to the NLTE and the finiteness of the measure it. The ideal situation 
is as follows: 

• structural properties of the Petri net (i.e. independent of the firing 
rates) ensure the existence of a strictly positive solution to the NLTE; 

• conditions on the firing rates ensure the finiteness of the measure n. 

2.2 Linear traffic equations and Haddad & al's Theorem 

Solving the non-linear traffic equations is still a challenging task. We may 
avoid a direct attack to these equations by considering a simpler system of 
equations called the linear traffic equations. 

Definition 2.2 (Linear traffic equations). We call linear traffic equations 
(LTE) the equations over the unknowns (yc)ceC defined by: VC € C, 

VC Kt= ^2 K tVl(t) • ( 14 ) 

t:I(t)=C t:0(t)=C 

Furthermore, i/0 £ C, then y$ = 1. 

The NLTE and the LTE are clearly linked. 

Lemma 2.1. If the NLTE have a strictly positive solution u = (u p ) P £-p, 
then v = {v c )cac, 

vc= II u p P ' ( 15 ) 

is a strictly positive solution to the LTE fl 14\ )- 

For a partial converse statement, see Lemma [2 .21 The following proposi- 
tion provides a simple and structural criterium for the existence of a strictly 
positive solution to the LTE. 

Proposition 2.1. The following statements are equivalent: 

• 3(nt)t£T such that the equations Ji^[ ) have a strictly positive solution. 

• V(Kt)teT> the equations (T^P have a strictly positive solution. 

• The Petri net is weakly reversible. 
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Proofs can be found in [5l Theorem 3.5] or Corollary 4.2]. We recall 
the argument from [5] which is simple and illuminating. 

Proof. The reaction process is a continuous-time Markov process, analog to 
the marking process, except that it is built on the reaction graph instead of 
the marking graph. More precisely, the state space is the set of complexes 
C and the infinitesimal generator Q = (q u ,v)u,v is defined by: 

Vn / v, q UyV = K t . 

t:I{t)=u,0(t)=v 

(The discrete-time version of this process was introduced in [T5| under the 
name "routing process".) The key observation is that the LTE (|14p are 
precisely the balance equations yQ = of the reaction process. The result 
now follows using standard Perron-Frobenius theory. □ 

So weak reversibility is a necessary condition to have a strictly positive 
solution to the NLTE, and to be able to apply Theorem 12. 11 Unfortunately, 
it is not a sufficient condition as shown by the following example. 

Example 3. Let us consider a Markovian Petri net whose underlying Petri 
net is shown in FigureUl and is equivalently defined by the chemical reactions 
This is a weakly reversible Petri net, thus its LTE always have a strictly 
positive solution regardless of the choice of the constants K t . The NLTE are: 

KlXl = K2X2 H3X3 = K4X4 = KQX2X4 . (16) 

The system lilo}) does not always have a strictly positive solution. For ex- 
ample, set k± = «2 = K3 = k>4 = K5 = 1, and kq = 2. Any solution to A16\) 
must satisfy either x\ = X2 = or x% = x^ = 0. 

Depending on the values of the constants (nt)t> the Markovian Petri net 
may or may not have a product form invariant measure. Anticipating on 
Theorem \2.3[ the deficiency of the Petri net has to be different from for 
this property to hold. And, indeed, we have rank(A) = 3 and rank(N) = 2 
so the deficiency is equal to 1. 

So now the goal is to find additional conditions on top of weak reversibil- 
ity to ensure the existence of a product form. 

An early result in this direction appears in Coleman, Henderson and 
Taylor [6J Theorem 3.1]. The condition is not structural (i.e. rate depen- 
dent) and not very tractable. The next result, due to Haddad, Moreaux, 
Sereno, and Silva [141 Theorem 9], provides a structural sufficient condition. 

Proposition 2.2. Consider a Markovian Petri net (set of complexes C). 
Assume that the Petri net is weakly reversible. Let N be the incidence matrix 
of the Petri net, see (TTp. Let A be the node-arc incidence matrix of the 
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reaction graph, see |3)). Assume that there exists a Q)-valued (C x V)-matrix 
B such that BN = A. Then the marking process has an invariant measure 
tt given by: \/x G TZ(Mq), 

n(x)=$( X r i ncn % c, t p < 

pcv cec 

where v is a strictly positive solution to the LTE. 
2.3 Deficiency zero and product form 

Independently of the efforts in the Petri net community ([U Ej), the fol- 
lowing result was proved on the chemical side by Feinberg ]\\\ Theorem 
5.1]. 

Theorem 2.2 (Feinberg). Consider a Markovian Petri net. Assume that 
the Petri net has deficiency 0. Then the NLTE have a strictly positive solu- 
tion if and only if the network is weakly reversible. 

By combining Theorems 12 . 1 1 and 12 . 21 we obtain the following result whose 
formulation is original. 

Theorem 2.3. Consider a Petri net which is weakly reversible and has 
deficiency 0. Consider any associated Markovian Petri net. The NLTE 
have a strictly positive solution (u p ) p and the marking process has a product 
form invariant measure: 

tt(x) = ^(x)- 1 n u/ . (17) 

If we assume furthermore that the rates are of mass-action type MU\) . then 
the marking process is ergodic and its stationary distribution is: 

*(*)=cn£, 

P ev Xp - 

where C = (J2 x u p P / x p0 ■ 

The above result is interesting. Indeed, the "deficiency 0" condition 
is structural and very simple to handle. We now prove that the result in 
Theorem 12.31 is equivalent to the one in Proposition 12.21 

Proposition 2.3. Consider a Petri net. There exists a (C x V)-matrix B 
such that BN = A (with the notations of Prop, \2.2i) if and only if the Petri 
net has deficiency 0. 
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Proof. The deficiency of the Petri net is iff rank(iV) = rank(.A). 

Assume first that there exists a matrix B such that BN = A. Since 
BN = A, we have rank(A) ^ rank(iV). By Proposition 11.11 we aiso have 
rank(A) ^ rank(iV). Therefore the Petri net has deficiency 0. 

We now prove the converse result. Assume that the Petri net has de- 
ficiency 0. Set r = \C\ — i. We have rank(A) = rank(iV) = r. Since 
rank(A) = r, we know that there exists an invertible and Q-valued (T x T)- 
matrix Q such that the first r column vectors of AQ are linearly independant 
and the last (\T\ — r) column vectors are (0, . . . , 0) T . According to (J5D, the 
last (|7~| — r) column vectors of NQ are (0, . . . , 0) T . But rank(TV) = r, so 
the first r column vectors of NQ must be linearly independant. Denote by 
AQi, . . . , AQ r , resp. NQi, . . . , NQ r , the first r column vectors of AQ, resp. 
NQ. Since the two families are independent, we know that there exists a 
Q-valued (C x "P)-matrix B such that BNQi = AQi, for alH = 1, . . . , r. In 
other words, 

BNQ = AQ . (18) 
Finally, right-multiplying both sides of (|18p by Q~ l , we obtain BN = A. □ 



Roadmaps. The main results are summarized in the diagram of Figure 
[31 In the diagram, (N)LTE is a shorthand for: "the (N)LTE have a strictly 
positive solution" . 



Product form 



Theorem 3.2 



NLTE 
I 



Lemma 3.4 



Theorem 3.7 



Deficiency + WR 



Deficiency 



| Prop. 3.9 



Exists B: BN=A 



WR 



| Prop. 3.5 



LTE 



Figure 3: Roadmap of the results 

The implications which do not appear on Figure[3]are false. The counter- 
examples are summarized on Figure HI (Using Lemma 12.11 and Prop. 12.11 
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any Petri net of deficiency and not WR is a counter-example to ["deficiency 
0" "NLTE for some rates"].) 



Product form 

Section 3.7 



NLTE for some rates 



I 



Example 3 



Ex. 3 

X 



NLTE for every rates 



X 



X 



■r Deficiency + WR 



Example 3 

>< 



Deficiency Figure 2 



Figure 2 



X 



WR 



Figure 4: Roadmap of the counter-examples 

The product form property depends on the initial marking via the reach- 
ability set, while the other properties appearing in Figure [3] do not depend 
on it by definition. This provides a striking picture. In fact, for Petri nets 
which are weakly reversible and have deficiency zero, when the initial mark- 
ing varies, the product form remains the "same" but is defined on different 
state spaces. We illustrate this point in 523 and we come back to it in £ )2.71 

2.4 A detailed example 

Consider the Petri graph represented on the left of Figure The corre- 
sponding reaction graph is given on the right of the figure. 

The reaction graph is strongly connected so the Petri graph is weakly 
reversible. The incidence matrices N and A are given by (indices are ranked 
as (p,q,r), (h,t2,h), and (2p,p + q + r, 2q)): 



N 



We check that rank(A) = rank(iV) = 2, so the deficiency is 0. We are in 
the scope of application of the results of Section 12.31 

Denote a marking M by the triple (M p , M q , M r ). Consider the two 
Petri nets corresponding to the above Petri graph with two different initial 
markings: (2,0,0) and (3,0,0). 



-1 


2 


-1 


1 


-2 


1 


1 





-1 
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p + q + r 



Figure 5: A Petri graph and its reaction graph. 



The two Petri nets have a drastically different behaviour. The first one 
is live and bounded, while the second one if live and unbounded. The sets 
of reachable markings are, respectively, 

71(2,0,0) = {(2,0,0), (1,1,1), (0,2,0)} 

71(3,0,0) = {(1,2,0), (0,3,1)} U {(t,3 -*,2n+ 1 - i), < i < 3,n > l} 

For the initial marking (2,0,0), the marking graph is the elementary 
circuit (2, 0, 0) — > (1, 1, 1) — > (0, 2, 0) — > (2, 0, 0). For the initial marking 
(3,0,0), the marking graph is represented in Figure [6j The dashed arrows 
correspond to transition t±, the dash-and-dotted ones to £2, an d the plain 
ones to £3. 



(0,3,1)* 



(0,3,3) 




(0,3,2n-lV (0,3,2n + l) 



(l,2,2ra-2X\\ (l,2,2n) * \ \ (1, 2, 2ra + 2) 



(2, l,2n- 1)\ Y(2,l,2n + 1) 



* (3,0,0) *(3,0,2ra - 2) *(3,0,2n) 

Figure 6: Marking graph with the initial marking (3,0,0). 

Consider the Markovian Petri nets associated with the above Petri nets 
and constant firing rates (k\, K2, K3) for (£1,^2, £3)- The NLTE over the 
unknowns (x p ,x q ,x r ) are given by 



KlXp — K2%qi 



hh^XrpXqXj* — K^Xpj hi^X q 



fc^X pX qX<f 



A strictly positive solution to the NLTE is (y^/y^Ki, 1 , -^1^2/^3)- 
Let 1Z denote the set of reachable markings. According to Theorem 1 2. 3 [ the 
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invariant measure ir is given by 

Vm = (m p , m q , m r ) G K, 7r(m) = .K-^J/^K+^V^-m, (19) 

The invariant measure is expressed in exactly the same way for the two Petri 
nets. But it corresponds to two very different situations. 

For the initial marking (2,0,0), we have \1Z\ = 3, the model is ergodic 
and the unique stationary distribution p, obtained by normalization of (|19p . 
is given by 

p(2,0,0) =C~ 1 K 2 K 3 , p(l, 1,1) =C" 1 Ki K2, p(0,2,0) =C- 1 KlK3, 

with C = + «2 K 3 + 

For the initial marking (3,0,0), we have \1Z\ = 00, and the model is 
ergodic if and only if the following stability condition is satisfied 

It is interesting to observe that we get a non-linear stability condition. 
2.5 Additional results 

The statements of Proposition 12.21 and Theorem 12.31 differ in that they rely 
respectively on the LTE and the NLTE. In particular, it seems at first glance 
that Prop. 12.21 manages to bypass the NLTE. But it is not the case: the 
NLTE are hidden in the matrix B, see below. 

Lemma 2.2. Consider a weakly reversible Markovian Petri net. Assume 
that there exists a Q-valued matrix B such that BN = A (notations of 
Prop, \2.fy) . Let v = (fc)cec be a strictly positive solution to the LTE. Then 
u = (up) p gp, Up = YiceC v c°' P ^ s a stripy positive solution to the NLTE. 
Proof. For each transition t, we have: 

v v v c 



E p Bc, P Np,t _ - Ao ,t _ v I(t) 

v c 



C C 



VQ(t) 



Then we have 

[u strictly positive sol. NLTE] -<=^ VC, Kt = Kt J^J Up^ p 

i(t)=c o(t)=c P 



vc, y] Kt = y~] K t 



j2 ^ 

i{t)=c o(t)=c 
[v strictly positive sol. LTE] . 

□ 
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Let us comment on a specific point. Consider Theorem 12.31 The in- 
variant measure is defined in fonction of a specific strictly positive solution 
to the NLTE. However, it is easily seen that the NLTE may have several 
strictly positive solutions. Is this contradictory with the uniqueness of the 
stationary measure in the ergodic case ? In the non-ergodic case, do we get 
several invariant measures ? The next result answers these questions. 

Lemma 2.3. Assume that the Petri net is weakly reversible and has defi- 
ciency 0. Let u, u be solutions to the NLTE and tt, tt be the corresponding 
invariant measures (given by (T7\))- Then there exists a constant K such 
that for all reachable marking x, tt(x) = Kir(x). 

Proof. It suffices to show that 

n(x - I{t) +0{t)) v(x - I(t) + 0(t)) 



ir(x) tt(x) 



(20) 



for all reachable marking x and for all enabled transition t of i. Define 

v = {v c )cec, and v = (v c )cec by 



vc = Y\_ u p"' y c = II u p" 



According to Lemma l2.lt v an d v are solutions to the LTE. Equality (|20p 
holds if and only if 

tt u o{t) P -i{t) P = tt %o(t)p-i(t) P ^ v Q(t) _ J^w frp(t) _ 
v p p v Vm ^ m Vo{t) Vm ' 

The last equality is proved by Feinberg in [TTJ Proposition 4.1]. □ 



2.6 Algorithmic complexity 

Let us compare Proposition 12.21 and Theorem 12.31 from an algorithmic point 
of view. 

In both cases, one needs to check weak reversibility. Using Proposition 
12.11 weak reversibility is equivalent to the existence of a strictly positive 
solution to the LTE. This last point can be checked in time 0(C 3 ). Then 
the procedures diverge. 

• Proposition ^. °A We need to compute the matrix B satisfying BN = A. 
This requires to solve C linear systems of dimension V x T ■ So the 
time-complexity is 0(CVT 2 ) using Gaussian elimination. 

• Theorem \2.tA We have seen in Section 11.21 that the deficiency con- 
dition can be checked in time 0(PT 2 ). Then one needs to compute 
a strictly positive solution to the NLTE. This can be done as follows. 
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Consider (|15p . apply the logarithm operation on both sides and solve 
the linear system. The corresponding time-complexity is 0(VC 2 ) (= 
0{TT 2 ) since \C\ < 2\T\). 

We conclude that it is more efficient asymptotically to determine the 
product form by using the characterization in Theorem 12.31 

2.7 A product form Petri net with no solution to the NLTE 

We have seen above that the existence of a strictly positive solution to the 
NLTE is a sufficient condition for the existence of a product form. However, 
it is not a necessary condition, and we now provide a counter-example. 




Figure 7: A product form Petri net which is not weakly reversible and has 
deficiency 1. 

Consider the Petri graph of Figure [7J It is not weakly reversible, so in 
particular there is no strictly positive solution to the NLTE. Furthermore, 
the deficiency is 1. 

Consider the initial marking Mq = (1,1,0,0). The marking graph is 
given on the right of Figure [7J By solving directly the balance equations of 
the Marking process, we get: 

c c c c c 

tt(IOIO) = , 7r(1100) = , 7r(0111) = ,vr(0201) = -^,7r(0021) = 

MlA*3 A*1^2 Hi ^3 

We have ir{x,y,z,t) = C '(1 / fi{) x (1 / \jl<i) v '(1 / ' \iz) z • So the Petri net has a 
product form. 

Consider now the same Petri graph with a new initial marking Mq = 
(1, 1, 1, 1). The marking graph is still finite (9 states), strongly connected but 
we no longer have a product form stationary distribution. Indeed, suppose 
that ir(x,y,z,t) = Ca x b v c z (tf where a,b,c,d are strictly positive constants. 
The balance equations for Mi = (2, 1, 0, 0) and Mi = (1, 2, 0, 1) are: 

cd a cd 

a bd a 
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These equations cannot be simultaneously satisfied, so the stationary distri- 
bution is not of product form. 



To summarize, as opposed to the case of "weakly reversible and deficiency 
0" Petri nets, the existence of a product form depends on the initial marking. 

3 Markovian free-choice nets and product form 

The class of Petri nets whose Markovian versions have a product form is 
an interesting one. It is therefore natural to study how this class intersects 
with the classical families of Petri nets: state machines and free-choice Petri 
nets. 

The central result of this section is, in a sense, a negative result. We 
show that within the class of free-choice Petri nets, the only ones which are 
weakly reversible are closely related to state machines. We also show that 
the Markovian state machines are "equivalent to" Jackson networks. The 
latter form the most basic and classical examples of product form queueing 
networks. 

From now on, we consider only non-weighted Petri nets, that is Petri 
nets with 1,0 : T -> {0, 1} V . In this case, the input/output bags can be 
retrieved from the flow relation J 7 and we can define the Petri net as a 
quadruple (V, T, J 7 , Mq). We also identify complexes with subsets of V. 

For a node x G T U V, set 'x = {y : (y, x) G J 7 } and x' = {y : (x, y) G 
J 7 }. For a set of nodes S C 7~U V, set 'S = \J x€S 'x and S' = \J xe s x '- 

3.1 State machines 

Definition 3.1 (State machine and generalized state machine). A non- 
weighted Petri net N = (V, T, J 7 , Mq) is a: 

• State machine (SM) if for all transition t, \'t\ = \t'\ = 1; 

• Generalized state machine (GSM) if for all transition t, \'t\ < 1, \t'\ < 



Definition 3.2 (Associated state machine). Given a GSMN = (V, T, J 7 , Mq), 
the associated state machine is M' = (V' , T, J 7 ', Mq) where: 



1. 



• V' = VU{p},p (£V 



• r 



TU{(p,t),t G T,\'t 



0}u{(t,p),ieT,|f|=0} 



• Vx G V, Mq 



(x) = M (x) 




(p) = 0. 
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The figure below shows, from left to right, a SM, a GSM and its associ- 
ated SM. 



Lemma 3.1. The reaction graph and the Petri graph of a state machine 
are isomorphic. The reaction graph of a GSM and the Petri graph of its 
associated SM are isomorphic. 

Proof. In a SM, each complex is just one place. Starting from the Petri 
graph and replacing [p — > t — > q], p, q € V, t € T, by \p — > q], we get the 
reaction graph. For GSM, the mapping is the same with the empty complex 
corresponding to the "new" place in the associated SM. □ 

Corollary 3.1. A SM is weakly reversible iff each connected component is 
strongly connected. A GSM is weakly reversible iff in the associated SM, 
each connected component is strongly connected. 

In a SM, the complexes are the places. So the NLTE and the LTE 
coincide exactly. For a GSM, the complexes are the places and the empty 
set. With the convention y@ = 1, we still have that the NLTE and the LTE 
coincide. The next proposition follows. 

Proposition 3.1. Consider a weakly reversible GSM. For every rates («t)t, 
the NLTE have a strictly positive solution. 

Proof. In the weakly reversible case, the LTE have a strictly positive solution 
for every choice of the rates, Proposition 12.11 Therefore the NLTE have a 
strictly positive solution for every choice of the rates. □ 

The above proof does not require Feinberg's Theorem 12.21 However, it 
turns out that the deficiency is 0, which provides a second proof of Prop. 
13.11 using Theorem 12.21 

Proposition 3.2. Generalized state machines have deficiency 0. 

Proof. Consider first a state machine. Let N be the incidence matrix, and 
let A be the node-arc incidence matrix of the reaction graph, see ([3]). Using 
Lemma 13-H we get immediately that A = N. So, in particular, we have 
rank(A) = rank(iV) and the deficiency is 0. 

Consider now a GSM N and its associated SM N' . Call C (resp. C), N 
(resp. N') and I (resp. £') the set of complexes, the incidence matrix and 
the number of connected components of the reaction graph of ftf (resp. A/ 7 ). 




P 



— o — 

D — — Lfl — -O — -D- 
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Since N and N' have the same reaction graph (Lemma 13. ip . we have: 

\C\ = \C'\, £ = £'. (21) 

By construction of A/ 7 , N' is N augmented with a row (xt)teT defined 
by xt = l{ t . = 0| — lr. t= 0i (where t' and *t are defined in M). We have 
rank(iV') > rank(iV). On the other hand, observe that Vi G T",^ = 
— Ylsev N s ,t, so iV' = BN, where B is the V xV identity matrix augmented 
with the row (— 1, . . . , — 1). Hence rank(iV') = rank(BN) < rank(iV). So: 

rank(N') = rank(TV) . (22) 

Together (|2ip and (|22p imply that N and A/"' have the same deficiency. 
Since N' is a SM, it has deficiency zero, so M also has deficiency zero. □ 

By coupling Proposition 13.11 and Theorem 12. 1^ or alternatively Proposi- 
tion [32] and Theorem 12.31 we get the result below. 

Theorem 3.1. Consider a Markovian weakly reversible GSM. The defi- 
ciency is 0. The NLTE have a strictly positive solution (u p ) p . The marking 
process admits a product form invariant measure given by: Vx G 1Z{Mq), 

7T(X) = ^(X)- 1 J] Up P . 

If $ C, the state space TZ(Mq) is finite, the marking process is ergodic, and 
7T can be normalized to give a product form stationary distribution: \/x G 
K(M ), 

5r(x) = B^(x)- 1 11 4 P , 

where B = {J2 xe n(M ) U P& v "p P ) _1 - 

Theorem 13. II is far from a surprising or new result, as we now show. 
3.2 Jackson networks 

The product form result for Jackson networks is one of the cornerstones of 
Markovian queueing theory. It was originally proved by Jackson [16] for 
open networks and by Gordon & Newell [13] for closed networks. 

Consider a Markovian weakly reversible SM with constant rates {ntjt&T- 
It can be transformed into a Jackson network as follows: 

• A place s becomes a simple queue, that is a single server Markovian 
queue with an infinite buffer. The service rate at queue s is fi s = 
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• The routing matrix P of the Jackson network is the stochastic matrix 
defined by: 



Vu, v G V, P, 



u,v 



1 Ht:'t=u,t-=v K t if 3t G T, « -»• t -> v 
otherwise 



• A token in place s becomes a customer in queue s. 

Consider now a Markovian weakly reversible GSM with constant rates 
(nt)t£T- On top of the above transformations, we do the following: 

• A transition t with 't = becomes an external Poisson arrival flow of 
rate Kt in queue t*. 

The routing matrix P is now substochastic. Indeed, if the transition t is 
such that f = 0, then ^ v P. t)V < 1. 

In the SM case, the Jackson network is closed, that is without arrivals 
from nor departures to the outside. In the GSM case with input and output 
transitions, the Jackson network is open. 

A Jackson network can be translated into a Markovian (G)SM using the 
reverse construction. 

The two models are identical in a strong sense. Precisely, the marking 
process of the state machine and the queue-length process of the Jackson 
network have the same infinitesimal generator. 



o 




Ho 



^3 

-o 





Figure 8: From (generalized) state machine (left) to Jackson network (right). 



The classical product form results for Jackson networks (Jackson |16] 
and Gordon Sz Newell |13j ) are exactly the translation via the above trans- 
formation of Theorem 13.11 In the open case, the weak-reversibility implies 
the classical "without capture" condition of Jackson networks. 

The above transformation from GSM to queueing network can also be 
performed in the case of general rate functions of type (J7J). Queueing net- 
works with those rate functions are called Whittle networks in the literature. 
The existence of product form invariant measures for these networks is a 
classical result, see for instance [23] and the references therein. 
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3.3 Free-choice Petri nets 



We study the family of live and bounded free-choice nets. This is an impor- 
tant class of Petri nets realizing a nice compromise between modelling power 
and tractability, see the dedicated monography of Desel & Esparza [5]. We 
show that the only such Petri nets having a product form are, in a sense, 
the GSM. 

Definition 3.3 (Free-choice Petri net). A free-choice Petri net is a non- 
weighted Petri net (V,T, J 7 , Mq) such that: for every two transitions t\ and 
t 2 , either m t\ = m t 2 or m ti D *t 2 = 0. 

Some authors call the above an extended free-choice Petri net and have 
a more restrictive definition for free-choice Petri nets. 

In the figure below, the Petri net on the left is free-choice, while the one 
on the right is not free-choice. 

o o o o 



Figure 9: Free-choice (left) and non free-choice (right) Petri nets. 

Definition 3.4 (Cluster). The cluster of a node x £ PUT, denoted by [x], 
is the minimal set of nodes such that: (i) x £ [x]; (ii) Vt G T : t € [x] ==>• 
't C [x] ; (iii) \/p £ V : p £ [x] ==> p' C [x] . 

The clusters form a partition of the set of nodes, see Proposition 4.5], 
and therefore of the places. Moreover, we have the following. 

Lemma 3.2. Consider a weakly reversible free-choice Petri net. The non- 
empty complexes are disjoint subsets of V . The partition of V induced by 
the non-empty complexes is the same as the partition of V induced by the 
clusters. 

Proof. In a weakly reversible free-choice Petri net, the non-empty complexes 
are also non-empty input bags, which are disjoint according to the definition 
of free-choiceness. 

It follows from the definition of clusters that every non-empty input bag 
is entirely contained in a cluster. This cluster is unique because the clusters 
partition the set of places. Let I be a non-empty complex (which is also 
a non-empty input bag). Denote by [I] the cluster containing /. We have 
/* C [I], so / U /* C [/]. Since the Petri net is free-choice, *t = I for all 
t £ I'. The set I L) I' satisfies the three conditions of the definition of 
clusters, so we have [I] C I U I' . We conclude that [J] = JU I" and / is the 
set of places of the cluster [I] . 
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Conversely, let [x] be a cluster such that [xJfTP 7^ 0. Let / be a non-empty 
input bag contained in [x]. We have, using the above, [I] = IUl' C [x]. By 
minimality, [I] = [x] and [x] n V = I. □ 



The above result is not true for a non-WR free-choice Petri net. Consider 
for instance the Petri net represented in the upper-right part of Figure [2j 

Under the assumptions of Lemma [3.2[ the non-empty complexes are dis- 
joint. Thus each non-empty complex behaves as if it was a "big place". 
Consider the operation which reduces each non-empty complex to a single 
place. The resulting Petri net is a generalized state machine. And this gen- 
eralized state machine is weakly reversible because the original free-choice 
Petri net was weakly reversible. Let us define all this more formally. 

Definition 3.5 (Reduced generalized state machine). LetAf = (V, T, J 7 , Mq) 

be a weakly reversible free-choice Petri net with set of complexes C. We 
call the reduced generalized state machine (RGSM) of M the GSM 1ZM = 
(C\{0},T,-F,M o ) where: 

• F={Ct,t),(t,f),teT}; 

• M is defined by: VC G C \ {0}, M (C) = mm peC M (p). 

The Petri graph of TZM is the reaction graph of N reinterpreted as a 
Petri graph (the nodes of the reaction graph are the places, and a transition 
is added to each arc). 

Lemma 3.3. Let N be a weakly reversible free-choice Petri net and 1ZN its 
RGSM. The marking graph oflZN is isomorphic to the one of M . If M and 
TZM are Markovian with the same rates then the two marking processes are 
"identical", meaning that they have the same infinitesimal generator. 

Proof. Consider two places p and q belonging to the same complex. Since the 
complexes are disjoint, Lemma [321 each time p gains (resp. loses) a token, 
so does q. So the difference M p — M q is invariant over all the reachable 
markings M. It has the following consequence. 

Consider / : K{M Q ) -> N c \ defined by f(M) c = min peC M(p). If 

M 4 M' in M then f(M) 4 f(M') in TIN. So f(K(M )) = H(M ) and 
the marking graph of 1ZN is the marking graph of N up to a renaming of 
the nodes. 

Since the marking graphs are the same, the infinitesimal generators are 
also identical if the two Petri nets have the same rates. □ 

One could introduce the RGSM associated with a non-WR free-choice 
Petri net as in Definition 13.51 see Figure ITTJl But in this case Lemma 13.31 
does not hold, and the two marking graphs may have nothing in common. 
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Now let us compare the structural characteristics of the original free- 
choice Petri net N and of the reduced generalized state machine TZN. 



Figure 10: A non-WR free-choice net and the associated RGSM. 

Lemma 3.4. LetN be a weakly reversible free- choice Petri net. The RGSM 
1ZN is weakly reversible and has the same deficiency as N . 

Proof. The weak reversibility of 1ZN follows directly from the definition of 
reduced generalized state machines. 

The Petri graph of 1ZN is isomorphic to its reaction graph, Lemma 
13.11 Now by construction, N and 1ZN have the same reaction graph. So 
the number of complexes and the number of connected components of the 
reaction graph do not change. Call ./V and N' the incidence matrices of N 
and 1ZN respectively. Let C be an arbitrary complex, let p,p' be two places 
of C. For every transition t, we have N p t = N p i t = N'c,u which implies that 
rank(iV) = rank(iV'). So the two Petri nets have the same deficiency. □ 

Corollary 3.2. Weakly reversible free-choice Petri nets have deficiency 0. 

Now all the results for weakly reversible GSM can be applied to weakly 
reversible free-choice Petri nets. We get the following. 

Theorem 3.2. Repeat the statement of Theorem \3.1\ with "free-choice Petri 
net" replacing "GSM". 

Acknowledgement. We are grateful to Serge Haddad for fruitful dis- 
cussions and for suggesting the example of Section 12.41 
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